TIIS (한국인터넷정보학회)
Current Result Document :
| 한글제목(Korean Title) |
Stylized Image Generation based on Music-image Synesthesia Emotional Style Transfer using CNN Network |
| 영문제목(English Title) |
Stylized Image Generation based on Music-image Synesthesia Emotional Style Transfer using CNN Network |
| 저자(Author) |
Baixi Xing
Jian Dou
Qing Huang
Huahao Si
|
| 원문수록처(Citation) |
VOL 15 NO. 4 PP. 1464 ~ 1485 (2021. 04) |
한글내용
(Korean Abstract) |
|
영문내용
(English Abstract) |
Emotional style of multimedia art works are abstract content information. This study aims to explore emotional style transfer method and find the possible way of matching music with appropriate images in respect to emotional style. DCNNs (Deep Convolutional Neural Networks) can capture style and provide emotional style transfer iterative solution for affective image generation. Here, we learn the image emotion features via DCNNs and map the affective style on the other images. We set image emotion feature as the style target in this style transfer problem, and held experiments to handle affective image generation of eight emotion categories, including dignified, dreaming, sad, vigorous, soothing, exciting, joyous, and graceful. A user study was conducted to test the synesthesia emotional image style transfer result with ground truth user perception triggered by the music-image pairs’ stimuli. The transferred affective image result for music-image emotional synesthesia perception was proved effective according to user study result.
|
| 키워드(Keyword) |
Affective Computing
Image Style Transfer
Deep Convolutional Neural Networks
|
| 파일첨부 |
PDF 다운로드
|
